D 4.2. Multimodal Interaction Techniques

This report presents our approach for multimodal interaction in the COVEN virtual environments and describes the functions and architecture of the multimodal interaction techniques modules that have been developed so far. A first milestone was reached in our work, with the completion of a first set of modules focusing on generic techniques. Both the overall functional architecture and the process architecture are described, with a particular focus on APIs between the VE and NLP/Dialogue sub-systems. D4.2 Multimodal interaction techniques January 97 2 Keyword list: Multimodal interaction, speech-based interaction, natural language processing D4.2 Multimodal interaction techniques January 97 3 Table of